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SMALL TIME PATH BEHAVIOR OF DOUBLE STOCHASTIC 
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STOCHASTIC CONTROL 

By Patrick Cheridito/ H. Mete Soner^ and Nizar Touzi 

Princeton University, Kog University and Centre de Recherche 
en Economic et Statistique 

We study the small time path behavior of double stochastic inte- 
grals of the form £{J^ h(u) dW{u))'^ dW{r), where W is a d- dimensional 
Brownian motion and b is an integrable progressively measurable 
stochastic process taking values in the set of d x d-matrices. We prove 
a law of the iterated logarithm that holds for all bounded progres- 
sively measurable b and give additional results under continuity as- 
sumptions on 6. As an application, we discuss a stochastic control 
problem that arises in the study of the super-replication of a contin- 
gent claim under gamma constraints. 

1. Introduction. In this paper we study the small time path behavior of 
double stochastic integrals of the form V^{t) = /q (/q'' 6(n) dVF(u))^ (iVF(r), 
where is a d-dimensional Brownian motion and h is an integrable pro- 
gressively measurable stochastic process taking values in the set of d x d- 
matrices. We first proove a law of the iterated logarithm under general as- 
sumptions. Then, we prove additional results under continuity assumptions 
on b. The results for V'^ can easily be generalized to double stochastic inte- 
grals of the form Jq{Jq b{u) dM{u))''" dM{r), for d-dimensional martingales 
M(t) = jQm(r)dW{r) corresponding to regular enough matrix-valued pro- 
cesses m. 

Results on the small time path behavior of stochastic integrals can be 
applied to characterize the set of all starting points from which a given 
controlled continuous-time stochastic process can be driven into a target set 
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at a prespecified future time. It is shown in [7] and [8] that under suitable 
conditions, the set of initial data from which a controlled state process can be 
steered into a target set, satisfies a dynamic programming principle (DPP), 
from which a dynamic programming equation (DPE) can be derived. Since 
in [7] and [8] the control process is constrained to take values in a subset 
of M'^, the essential step in the derivation of the DPE from the DPP is an 
analysis of the small time behavior of single stochastic integrals. In [6], the 
problem of super-replicating a contingent claim under gamma constraints 
is studied. This problem naturally leads to an analysis of the small time 
behavior of double stochastic integrals. The results in [6] are obtained under 
the assumptions that the contingent claim depends on only one underlying 
asset and that the gamma constraint is an upper bound. In this paper we 
provide a more extensive study of the small time path behavior of double 
stochastic integrals than in [6] and discuss the super-replication problem 
under upper and lower gamma constraints. 

In Section 2 we establish the notation and discuss basic examples of dou- 
ble stochastic integrals. The main results of the paper are stated and proved 
in Section 3, and in Section 4 it is shown how they can be used to find 
the super-replication price of a contingent claim in the presence of gamma 
constraints that are more general than in [6]. We keep the presentation in 
Section 4 simple by making strong assumptions. For a general treatment of 
the super-replication problem under gamma constraints in a multidimen- 
sional framework, we refer the reader to the accompanying paper [2]. 

2. Problem formulation and notation. Let (il., T ^ P) be a complete prob- 
ability space endowed with a filtration F := {J^{t),t > 0} that satisfies the 
usual conditions. We are interested in the small time behavior of double 
stochastic integrals of the form 



where {W{t),t > 0} is a d-dimensional Brownian motion on the filtered 
probability space {Q,J-',¥,P), {b{t),t > 0} is an integrable F-progressively 
measurable stochastic process with values in Al*^, the set of d x d-matrices 
with real components, and denotes the transposition of matrices. 

In the easy case where {W{t),t > 0} is a one-dimensional Brownian mo- 
tion and b{t) = (3, t>0, for some /3 G M, we have 



It follows from the law of the iterated logarithm for Brownian motion that 





V'>it) = ti{w\t)-t) 



t>0. 



(2.2) 




for every /? > 
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where 

:=2tloglogp t>0, 

and the equahty in (2.2) is, as all other equalities and inequalities between 
random variables in this paper, understood in the almost sure sense. On 
the other hand, it can be deduced from the fact that almost all paths of 
a one-dimensional Brownian motion cross zero on all time intervals (0,e], 
e > 0, that 

(2.3) lim sup = -j3 for every /3 < 0. 

The purpose of this paper is to derive formulae similar to (2.2) and (2.3) 
when W = {W{t),t > 0} is a d-dimensional Brownian motion and h = {b{t),t > 
0} is a progressively measurable matrix- valued stochastic process. Note that 
if b{t) = P, t>0, for some fixed symmetric matrix P, then 

2V^{t) = W{t)^f3W{t) - TT[(3]t, t > 0, 

where Tr denotes the trace of a matrix. It is already not completely obvious 
if the formulae (2.2) and (2.3) have analogs in this case and how they look. 
In Section 3 we will prove extensions of (2.2) and (2.3) for processes of the 
form (2.1). 

By Id we denote the d x d identity matrix. For y G M", we set |y| := 
(y? + • • • and for /? G M'^, 

\P\:= sup \Py\. 

By S'^ we denote the collection of all symmetric matrices of A4'^, and for all 
(3 G S'^, we set 

X4P) := min{y^/3y : y G \y\ = 1}, 

X*{P) :=max{//3y:yG]R^|y| = l}. 

Note that A* and A* are continuous, and therefore, measurable functions 
from to M. We endow the set S'^ with the usual partial order 

P>a if and only if A*(/? — a) > 0, 

and we set 5^ := {/? G cS"^ : /? > 0}. 

3. Small time path behavior of double stochastic integrals. The main 
results of this section are Theorems 3.1 and 3.3. Corollaries 3.7 and 3.8 are 
consequences of Theorems 3.1 and 3.3, respectively. Proposition 3.9, whose 
proof is straightforward, is given because, along with Corollaries 3.7 and 3.8, 
it is needed in Section 4 of this paper and in the accompanying paper [2]. 
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Theorem 3.1. (a) Let {b{t),t>0} be an M^-valued, ¥ -progressively 
measurable process such that \b{t) \ < 1 for all t>0. Then 

limsup — —T — < 1. 

i\o Ht) 

(h) Let P e S'^ with largest eigenvalue A*(/3) > 0. // {b{t),t > 0} is a 
bounded, S'^-valued, ¥ -progressively measurable process such that b{t) > (3 
for all t>0, then 

limsup--^ >A*(/3). 

For the proof of Theorem 3.1(a) we need the following exponential esti- 
mate: 

Lemma 3.2. Let A and T be two positive parameters with 2 AT < 1 and 
{b{t),t > 0} an -valued, ¥ -progressively measurable process such that 
\b{t)\<l, for allt>0. Then 

E[exp(2Ay^(r))] < E[exp(2A1/^'*(T))]. 

Proof. We prove this lemma with a standard argument from the theory 
of stochastic control. We define the processes 

Y\r) :=y(0)+ rb{u)dW{u) 
Jo 

and 

Z\t) := Z(0) + l\Y\r)f dW{r), t > 0, 
Jo 

where 1^(0) € M.'^ and Z{0) G M are some given initial data. Observe that 
V''{t) = Z^{t) when y(0) = and Z(0) = 0. We split the argument into 
three steps. 

Step 1. It can easily be checked that 
(3.1) neM'iXZ'^{T))\F{t)]=f{t,y''{t),Z'^{t)), 
where, for t E [0, T], y G M'^ and z G M, the function / is given by 

/(t, y, z) := E exp (^2a|z + j\y + Wir) - W{t)f dW{r) 

= exp(2Az) E[exp(A{2y^VF(r -t) + \W{T -t)\^ - d{T - t)})] 
= exp [2Az - dX{T -t) + 2^jlX^{T - t)|y|2], 
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and ^ := [1 — 2X(T — t)] ^. Observe that the function / is strictly convex in 
y and 



(3.2) D^yJit, y,z):= (t, y, z) = (t, y, z)y, 

where := 8/iA^(T — t)f is a positive function of {t,y, z). 



Step 2. For a matrix /? G A4'^, we denote by the Dynkin operator 
associated to the process that is, 

where -D. and D^. denote the gradient and the Hessian operators with respect 
to the indexed variables. In this step, we intend to prove that for all t £ [0, T], 

y G M"^ and z G M, 

(3.3) max f{t,y, z) = C''^ f{t,y, z) = 0. 

f3eM'i,\/3\<l 

The second equality can be derived from the fact that the process 

f{t,Y'^{t),Z'''{t)), tG[o,r], 

is a martingale, which can easily be seen from (3.1). The first equality follows 
from the following two observations: First, note that for each /3 G Ai'^ such 
that < 1, the matrix — is in Sf. Therefore, there exists a 7 G 5^ 
such that 

Since / is convex in y, the Hessian matrix Dyyf is also in 5^. It follows that 
^Dyyf{t,x,y)^ G 5^, and therefore, 

TT[Dlyf{t, X, y)] - Tr[P(3^Dlyf{t, x, y)] 

(3.4) =Tr[{Id-f3(3'^)Dy{t,x,y)] 

= Tt[jDlyf{t,x,y)j]>0. 

Second, it follows from (3.2) and the Cauchy-Schwarz inequality that, for 
ah peM'^ such that \(3\ < 1, 

{(3yfDlJ{t, y, z) = g\t, y, z){fiyYy 

(3.5) <g\t,y,z)\y\'' 

= y^DlJ{t,y,z). 
Together, (3.4) and (3.5) imply the first equality in (3.3). 
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Step 3. Let {b{t),t > 0} be an Al'^-valued, F-progressively measurable 
process such that \b{t) \ < 1 for all t>0. We define the sequence of stopping 
times 

Tfc := T A inf{t > : \Y\t)\ + > k}, 

It follows from Ito's lemma and (3.3) that 



f{0,Y{0),Z{0)) = f{Tk,Y'{n),Z'{Tk)) - / C'^'^f{t,Y\t),Z\t))dt 



Tk 



[{Dyffb + {DJ)y^]{t, Y\t), Z\t)) dW{t) 



>f{n,Y\n),Z\n)) 



[{DyfY b + {DJ)y']{t, Y\t), Z\t)) dW{t). 

Taking expected values and sending k to infinity, we get by Fatou's lemma, 
E[exp(2AZ^''(T))] = /(O, y(0), Z(0)) 

>UminfE[/(rfc,y''(rfc),Z^(rfe))] 

>E[/(T,y^(T),z^(r))] 

= E[exp(2AZ^(r))], 

which proves the lemma. □ 

Proof of Theorem 3.1. (a) Let T > and A > be such that 2 AT < 1. 
It follows from Doob's maximal inequality for submartingales and Lemma 3.2 
that for all a > 0, 



sup 2V^(t) > a 

0<t<T 



P 



sup exp(2Ay^(t)) > exp(Aa) 

0<t<T 



(3.6) 



< exp(-Aa) E[exp(2Ay''(r))] 

< exp(-Aa)E[exp(2Ay^''(r))] 

= exp(-Aa)exp(-Adr)(l -2Ar)~'^/2_ 

Now, take 6, r] e (0, 1), and set for all A: € N, 

ak:={l+V?h{e'') and Xk := [26'' {1 + r])]~\ 
It follows from (3.6) that for all k gN, 



sup 2V\t)>{l + r]yh{e'' 
Q<t<e^ 
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Since 

oo 
k=l 

it follows from the Borel-Cantelli lemma that, for almost all w G f], there 
exists a natural number K^''^{lo) such that for all k > K^'^{lo), 

sup 2V''{t,Lo) <{l+r])'^h{e''). 

In particular, for all t G (6'*-'+^, 0'^], 

2V\t,u:)<{l + ^fh{e^)<{l+r^f^. 

Hence, 

hmsup , , , < . 

tXo h{t) - 9 

By letting 6 tend to 1 and t] to zero along the rationals, we conclude that 



2V''{t) 
limsup — m~ ^ 1- 



On the other hand. 



limmf , , , = — limsup — — - — > —1, 
t\o h{t) t\o h{t) - 

and the proof of part (a) is complete. 

(b) There exists a constant c> such that for all t>0, 

(3.7) cid > b{t) >P> -cid, 

and an orthogonal d x d-matrix U such that 

P:=U(3U^ = dmg[X*{P),X2,...,Xd], 
where A*(/?) > A2 > • • • > are the ordered eigenvalues of the matrix /3. Let 

7 := diag[3c, c, . . . , c] and 'y:=U'^^U. 
It follows from (3.7) that for all t>0, 

l-P>l-h{t)>Q, 

which implies that 

|7 - ^(*)l < |7 - /9| = A*(7 - /3) = A* (7 - ^) = 3c - A*(/3). 
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Hence, by part (a), 

(3.8) limsup , , , <3c-A*(/?). 

t\o hit) 

Note that the transformed Brownian motion, 

W{t):=UW{t), t>0, 

is again a (i-dimensional Brownian motion and 

2V^{t) ^ WitY-iW{t)-l\hi)t 
lim sup , , . = Imi sup r--^; 

witfw{t)-^ii)t 

= Imi sup — 

(3.9) 

w{tfw{t) 

= hm sup —T 

t\o h{t) 

t\o hit) 
It follows from (3.9) and (3.8) that 

2V^{t) ^ 2V"i{t) , 2V"<-^{t) 

hm sup — ^ hm sup —r-r\ hm sup — — 

t\o hit) t\Q h{t) t\o hit) 

> 3c - (3c -A* (/?)) = A* (/3), 

which proves part (b) of the theorem. □ 

In the next theorem we refine the statements of Theorem 3.1 under 
stronger assumptions. 

Theorem 3.3. Let {b{t),t > 0} be an M'^ -valued, ¥ -progressively mea- 
surable process such that 



[ \b{r)\^ dr < oo forallt>0. 
Jo 



Assume that 6(0) is a deterministic element of S'^ , and there exists a random 
variable e > such that almost surely, 

(3.10) f \b{r)-b{Q)\^dr = 0{t^+') fort\0. 



(a) //A*(6(0)) <0, then 



2V'^it) 

lim sup — = - Tr [6(0)] . 

i\o t 
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(h) If X*{b{0))>0, then 

hmsup =A (6(0)). 

t\o hit) 

Remark 3.4. Note that for deterministic e > 0, condition (3.10) follows 
if there exists a constant C > such that 

(3.11) E[|fe(t) -KO)P] <Ct^^ fort>0. 

Indeed, if (3.11) is satisfied, then 

1 |6(r)-6(0)|2 



E 

therefore, 



■ dr 



< oo, 



Jo r^+= 



and we have for all t G [0, 1], 

Jo r^+^ Jo r^+^ 

To prove Theorem 3.3 we need the following. 

Lemma 3.5. Let {W(t),t >0} be a d- dimensional Brownian motion and 
peJ^"^. Then 

(3.12) liminf ^|VF(t)^/3M/(t)| = 0. 

Proof. It follows from the self-similarity property of {W{t),t > 0} that 
the Gaussian sequence, 

X(n) :=e"/2l^(e-"), n € Z, 

is stationary, and the fact that 

lim E[X(n)^X(0)] =0 

n— >oo 

implies that it is ergodic (see, e.g.. Section V.3 in [5]). Hence, the sequence 

Y{n) := \X{nfpX{n)\ = e"|M^(e-")^/?M^(e-'^)|, n G Z, 

is stationary and ergodic as well. Therefore, we can apply the ergodic theo- 
rem (see, e.g.. Theorem V.3. 3 in [5]) to conclude that for all 6 > 0, 

lim - 5] lloM^U)) = E[l[o,5](y(0))] = P[Y{0) <6]>0. 

j=0 
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This shows that 

liminf y(n) = 0, 

n— >oo 

which imphes (3.12). □ 

Proof of Theorem 3.3. Since 6(0) is symmetric, we have for ah t > 0, 

(3.13) 2V^{t) = 2F^(°)(t) + 2V\t) = W{tfb{0)W{t) - Ti[b{0)]t + 2V\t), 
where 

b{t):=b{t)-b{0), t>0. 



Denote by Mj the jth component of the d-dimensional local martingale 
jQb{u)dW{u), r > 0. It follows from assumption (3.10) that the quadratic 
variation process {Mj) satisfies almost surely, 

{Mj){r)= r Y.b'jkiu) du = 0{r^+') for t \ 0. 
•^0 k=l 

By the Dambis-Dubins-Schwarz theorem (see, e.g., Section V.l in [4]), there 
exists a Brownian motion Bj such that Mj{r) = Bj o (Mj)(r), r > 0. Hence, 
it follows from the law of the iterated logarithm for Brownian motion that 
almost surely, 

Mf{r)=0{r^+'/^) forr\0. 

This implies that almost surely, 

d 

and another application of the Dambis-Dubins-Schwarz theorem yields 



(y^)(t) = ^'^i (^) dr = 0{t^+'/^) for t \ 0, 

"^0 ,' 1 



(3.14) lim— ^ = 0. 

(a) If A* (6(0)) < 0, then for all t > 0, 

W{tfb{0)W{t) < 0, 

and part (a) of the theorem can be deduced from (3.13), (3.14) and Lemma 3.5. 

(b) If A*(6(0)) > 0, it follows from Theorem 3.1(b) that 

(3.15) limsup y > A* (6(0)). 

t\o hit) 
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To show that actually, 

(3.16) limsup ;^ =A*(b(0)), 

t\o hit) 

we denote by A* (6(0)) = Ai > A2 > • • • > the ordered eigenvalues of 6(0). 
There exists a positive integer k <d such that Ai > • • • > Afc > and, in case 
that k < d, > Xk+i ^ • • • ^ ^d- Let U be an orthogonal d x d-matrix such 
that 

C/6(0)C/^ = diag[Ai,A2,...,Arf]. 

The process 

W{t):=UW{t), t>0, 

is again a d-dimensional Brownian motion, and for all t>0, 

2y^(0)(t) , W(t)^b(0)W(t)-Ti:[bmt 
lim sup — — - — = lim sup — 

t\o h(t) t\o hit) 

= lim sup — —-T^ < lim sup - 



t\o h{t) i\o Kt) 

<Ai = A*(6(0)), 

where the last inequality follows from Theorem 3.1(a). This and (3.15) 
imply (3.16), which, along with (3.13) and (3.14), proves part (b) of the 
theorem. □ 

Our proof of Theorem 3.3 is based on the decomposition (3.13) and the 
estimate (3.14). The next example shows that (3.14) need no longer be true 
if assumption (3.10) is replaced by the condition that almost surely, 

|6(t) -6(0)1 ^0 ast^O. 

Whether Theorem 3.3, or some variant of it, can be proved under weaker 
assumptions is an open question. 

Example 3.6. hei d = l and h{t) = l/logloglog(l/t). Then, 

* f b{u)dW{u)dW{r) = W{t) [\{r)dW{r) 
Jo Jo 

t ft 

b{r)W{r)dW{r)- / h{r)dr 
Jo 



W{t) 



W{t)h{t) - / W{r)db{r 







rt 
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(3.17) 



W^{t)b{t)- W^{r)db{r)- h{r)dr 



^W'^{t)h{t)-W{t) j W{r)dh{r) 



2 



+ \ W^{r)dh{r)-\ / h{r)dr. 



Clearly, /q 6(r) dr = o(t), as t \ 0. Since 
b (r) 



r log(l/r) loglog(l/r) Vlogloglog(l/7') / ' 

it follows from the law of the iterated logarithm for Brownian motion that 
for t \ 0, 



W'^{r)dh{r)= / W"^ {r)h' {r) dr 
Jo 

= o( [ r loglog— b'(r) dr 
\Jo r 

= o(^j^ Idr^ =o{t). 



Similarly, for t \ 0, 



W{t) f^W{r)db{r) = W{t) I W{r)b'{r)dr 



o(^t log log J j \jr\og\og-b' {r) dr 



o{\j't log log - J r ^/^drj 



o| t\/ loglog^ j. 



Since 



I 1 / loglog(l/t) \ 

^Wloglog-=o t f ?^ ast\0, 
V t V log log log (1/t)/ 

it follows from (3.17) that 

J^J^biu)dW{u)dWir) 



lim sup 



t\o iloglog(l/t)/(logloglog(l/t)) 
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il/2)W\t)b{t) 

limsup ■ 



t\o t log log(l/i)/(log log log(l/t)) 

The next two corollaries are straightforward consequences of Theorems 
3.1 and 3.3, respectively. 

Corollary 3.7. Let {M(t),t > 0} be an W^-valued martingale defined 

by 

M{t) := f m{r)dW{r), t>0, 





where {m{t),t > 0} is an M'^-valued, ¥ -progressively measurable process 
such that 

t 

|m(r) p dr < oo for all t>0, 



and there exists a random variable e > so that almost surely, 

(3.18) r|m(r) -m(0)|2dr = 0(t^+^) fort\0. 

Jo 

( a) Let {b{t),t > 0} be a bounded M'^ -valued, ¥ -progressively measurable 
process such that for all t>d, |?n(0)"'"6(t)m(0)| < 1. Then 



lim sup 



2 



\Jo 



h{u) dM{u) dM{r) 



T 



< 1. 



(h) Let (3 be a bounded, J^{0) -measurable, S'^ -valued random variable with 
> 0. If{b{t),t >0} is a bounded, S'^-valued, ¥ -progressively measurable 
process such that for all t>0, 

m(0)^6(t)m(0) > /?, 

then 

lim sup /Y r b(u)dM(u)\ Mir) > A*(/?). 
t\o h{t) Jo \Jo J 

Proof. It can easily be checked that 

t / rr \T 

b{u)m{u) dW{u) ) ?n(r) dW{r) 



V^o 
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where 

c{t) :=m{Ofb{t)m{0), 
R^(t) := (^J\{u)[m{u) - m{0)]dW{u)^ m{0)dW{r), 

i?2(t) := (^J^ b{u)m{u) dW{u)^ [m{r) - m(0)] dW{r). 

As in the proof of Theorem 3.3 it can be deduced from assumption (3.18) 
and the Dambis-Dubins-Schwarz theorem that 



In particular, 



t\0 t t\Q t 



t\o h{t) t\o h{t) 



Now, part (a) of the corohary fohows from Theorem 3.1(a). Furthermore, 
by conditioning on a{f3), we can assume that /? is deterministic and deduce 
part (b) of the corollary from Theorem 3.1(b). □ 

Corollary 3.8. Let {M{t),t > 0} be an W^-valued martingale defined 

by 

M(t)= [ m{r)dW{r), t > 0, 





where {m(t),t > 0} is an M'^ -valued, ¥ -progressively measurable process 
such that 

rt 

|m(r) p dr < oo for all t>0. 



Let {b{t),t > 0} 5e a bounded, -valued, ¥ -progressively measurable process 
such that 6(0) is S'^-valued, and assume there exists a random variable e > 
such that almost surely, 

rt 

|m(r) -m(0)pcir = 0(t^+=) 



and 

rt 

|2 _ D/'+l+e 



\b(r)-b(Q)Ydr = 0{t'+^) fort\0. 

(a) //A*(m(0)^6(0)m(0)) < 0, then 

limsup- /Y r b{u)dM{u)] dM{r) = - Tr[m(0)^6(0)m(0)]. 
t\o t Jo \Jo J 
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(h) If X*{m{Ofb{0)m{0)) > 0, then 

limsup-^ f ( f h{u)dM{u)\ dM(r) =A*(m(0)^6(0)m(0)). 

Proof. As in the proof of Corollary 3.7 we decompose 

b{u)m{u) dW (u) ] m{r)dW{r) 



\Jo 
into 

r-t / rr \T 

c{u)dW{u)] dW{r) + Ri{t) + R2it), 

\J0 J 

where 

c{t) ■.= m{0)'^b{t)m{0), 



t 



(t) -=^1^ (yf^ b{u) [m{u) - m(0)] dW{u)^ m(0) dW{r) 



for t \ 0, 

1 I rt / rr X T 



t 



R^it) ■=\ (yf^ b{u)m{u) dW{u)J [m{r) - m(0)] dW{r) 



for t \ 0. 



It follows from the assumptions that c satisfies almost surely, 

ft 

\c{r)-c{0)fdr = O{t^+^) for t \ 0, 

and by conditioning on cr(c(0)), we can assume that c(0) is deterministic. 
Then, the corollary follows from Theorem 3.3. □ 

Proposition 3.9. Let {a{t),t > 0} and {m{t),t > 0} be two ¥ -progressively 
measurable processes taking values in and Ad'^ , respectively. Assume that 
{a(t),t>0} is bounded, 
rt 

|m(r) p dr < oo for all t>0, 



and there exists a {0,l]-valued random variable e such that almost surely, 

(3.19) f\'^\m{r)\^dr = 0{t^-'') fort\0. 

Jo 

Then, 

linit-2/2+e^*|^^' a(u)du^ m{r)dW{r) = 0. 
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Remark 3.10. It can easily be shown that 



(3.20) 



supE[|m(t)p] < oo 



implies condition (3.19) for every constant e G (0, 1]. Indeed, it follows from (3.20) 
that for every constant e G (0, 1] , 

|2 



E 



l-e 



■ dr 



and therefore, 



r 



^ |?Ti(r)|^ 



< oo 



r 



Moreover, for all t G [0, 1] , 



r^|m(r)p dr < 



dr < oo. 



^ \m{r)\^ 



r 



l-e 



drt 



3-£ 



Proof of Proposition 3.9. Denote X{t) = Jq{Jq a{u) du)'^m{r) dW{r), 
t>0. By assumption (3.19), the quadratic variation process (X) satisfies al- 
most surely, 

{X){t)=0{t^-') fort\0. 

Now, the proposition can be deduced from the Dambis-Dubins-Schwarz 
theorem. □ 



4. Applications to stochastic control. In this section we show how results 
on the small time behavior of stochastic integrals can be applied to derive 
partial differential equations from gamma constraints on hedging strategies. 
Since these partial differential equations will be derived from a dynamic 
programming principle (DPP), we refer to them as dynamic programming 
equations (DPEs). 

4.1. Super-replication under gamma constraints. For the sake of simplic- 
ity of presentation, we here consider a financial market that consists of only 
two tradable assets. Markets with more assets are considered in the accom- 
panying paper [2]. Let T > be a finite time horizon, let {W(t),t G [0,T]} 
be a one-dimensional Brownian motion and let F'^ = {T^{t),t G [0,T]} be 
the smallest filtration that contains the filtration generated by {W{t),t > 0} 
and satisfies the usual conditions. We take the first asset as numeraire and 
assume that the price of the second one is given by 

S{r) := ^oexpj (^/^ - + aW{r)^, r G [0,r], 
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for some constants > 0, ^ € M and o" > 0. By possibly passing to an equiv- 
alent probability measure, we can assume that /i = 0. Then, given S{t) = s 
for some {t,s) € [0,T) x (0,00), the further evolution of S is 

(4.1) 5(r) :=sexp|(j[H^(r) -H^(t)] - y(r-t)|, re[t,T]. 

A self-financing trading strategy that is only based on information coming 
from observations of the price {S{r),r G [0,T]}, can be described by an F^- 
progressively measurable process {Y{r),r G [i,?"]} that is integrable with 
respect to {S{r),r G [^,7"]} and denotes the number of shares of the second 
asset held at any given time. Then, the wealth process is given by 

(4.2) X{r)=X{t) + j\{u)dS{u), rG[t,r], 

and the number of shares of the first asset held at time r is X{r) — Y{r)S{r). 

We consider a contingent claim with a time-T payoff given by g{S(T)), 
where g : (0, 00) — > [0, 00) is a measurable function such that g{S{T)) G L^{P). 
For the corresponding Black-Scholes hedging strategy {Y^^{r),r G [t, T]} we 
have 

E[g{S{T))\m]+ jy'''{r)dS{r)=g{S{T)), 

that is, starting with initial capital E[g{S{T))\T{t)] at time t, the Black- 
Scholes strategy replicates the contingent claim. If one requires the hedging 
strategy to satisfy constraints other than conditions that exclude arbitrage 
opportunities, one cannot hope that the contingent claim is still replicable, 
but in many cases, it is possible to super-replicate it with finite initial wealth. 
A gamma constraint is a restriction on the variation of the hedging strat- 
egy due to changes in the underlying asset. To be able to express gamma 
constraints more explicitly, we require the process Y to be of the form 

(4.3) Y{r)=y + J\{u)du + J\{u)dS{u), re[t,T], 

for y G M and a, 7 bounded, F'^-progressively measurable processes. Then, 
a self-financing trading strategy is determined by the starting value y and 
a pair of bounded, F'^-progressively measurable processes v = (0,7). By a 
gamma constraint we mean a restriction on the process 7. In the following 
we consider gamma constraints of the form: 

(4.4) T,<S\r)jir)<T*, r€[t,T], 

where T* < T* are two given constants. We call a control process z/ = (0,7) 
admissible if a and 7 are bounded, F^-progressively measurable processes 
and 7 satisfies the constraint (4.4). 
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To emphasize the dependence on the initial data, we denote by {St^s, 
^t,s,x,y:^t,s,y) the processes given by (4.1), (4.2) and (4.3) corresponding 
to the admissible control v and the initial data {St,s,X^g„^y,Yl'gy){t) = 
(s, y). The collection of admissible controls u is denoted by At^s- From the 
boundedness of a and 7 it can be deduced that for all u G At^s^ 
s'ViY>t<r<T^[{^t,s,y{'^)^t,s{'r)}'^] < oo, and therefore, X^^^^^^y is a square-integrable 
martingale. In particular, admissible controls do not lead to arbitrage. 

The problems 

(4.5) w{t,s,y) := mi{x : X^ ,, ,j. y(T) > g{St^s(T)) for some v G A} 
and 

v{t,s) := mlw{t,s,y) 

(4.6) = infix ■.Xl,^,^y{T)>g{St AT)) 

for some y G M and some G A} 

can both be viewed as stochastic target problems. Problem (4.5) is very 
similar to the one treated in [7] and leads to the study of the small time 
behavior of single stochastic integrals. In problem (4.6), Y is no longer a 
state variable, and one is naturally led to an analysis of the small time 
behavior of double stochastic integrals. 

In the next two subsections we derive DPEs for w and v. Our main objec- 
tive is to show how one can find these DPEs and where results on the small 
time behavior of stochastic integrals are needed. To avoid the use of the 
theory of viscosity solutions and lengthy approximation arguments, we will 
make some strong assumptions along the way. In particular, we will assume 
that the infima in (4.5) and (4.6) are attained and the functions w and 
V are smooth. Also, we will only show that w and v are super solutions of 
the corresponding DPEs. A more detailed discussion of the super-replication 
problem under gamma constraints and rigorous proofs without simplifying 
assumptions can be found in [2]. 

4.2. DPE for the value function w. We derive the DPE for w in three 
steps. 

Step 1: Dynamic programming principle. We assume that for each (t, s, y) G 
[0,T) X (0, cxo) X M, there exists an admissible control u = (0,7) such that 

^ls,x,y{T) >g{St,s{T)) where x = w(t,s,y). 

Let r be an F'^-stopping time with values in (t,T]. For each 5 > 0, we 
define ts := t /\ {t + 5), and we set {s,x,y) := {St^s,X^,.^^y,Y^,.y){Ts). It can 
be deduced from 

^r„s,x,2}(r)>5(5r„Kr)) 
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that X > w{Ts,s,y), that is, 

(4.7) ^x;(t,s,y) + y^''V,;',,^(r)d5i,,(r)>^r5,5i,,(r5),y,;',,^(T5)). 

Step 2: Application of Itd^s lemma. We further assume that the value 
function w is smooth. Then, we can apply Ito's lemma in (4.7) to get for all 
6>0: 

(4.8) - C{r) dr - H ^j{r) dSt,s{r) > 0, 

Jt Jt 

where 

e(r) := g'^wir A r, St^r A r),Y,^,Jr A r)), 

V^(r) := {ws + iwy){r A r, 5t,,(r A r), ^.^.^^^(r A r)) - y,;;^j^(r A r), 

and Q'^ is the Dynkin operator associated to the two-dimensional process 
{S,Y-): 

g^wit, s, y) := wt{t, s, y) + a{t)wy{t, s, y) 

(4.9) + \a'^s^Wss{t, s, y) + \'-i{tfa^ s^Wyy{t, s, y) 

+ '^{t)a'^s^Wsy{t,s,y). 

If we set 

T := inf{r > t : \Yt\y{r) - y| + | log 5t,,(r) - log s| > A'} A T, 
for some constant K then the processes ^ and ip are bounded. 

Step 3: Small time path behavior of single stochastic integrals. Since is 
bounded, it follows from (4.8) that there exists a constant L > such that 



-^{u)dSt,s{u)= / -ij{u)St,s{u)(ydW{u)>-L{r-t) 

(4.10) 

for all r G [t, r]. 

By the Dambis-Dubins-Schwarz theorem, there exists a Brownian motion 
{B{r),r> 0} such that 

-ip{u)dSt,s{u) = B(^j\'^{u)Sl,{u)a'^d'<^, re [t,T]. 

Hence, it follows from (4.10) and the law of the iterated logarithm for Brow- 
nian motion that for all e, (5 > 0, 

P[\ip{u) \ >e for all n G [t, t 5]] = 0. 
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By the definition of ip and the gamma constraint (4.4) on the process 7, this 
provides 

(4.11) - Sr{-Wy{t,s,y)) < s'^{y - Ws{t,s,y)) < Sr{wy{t, s,y)), 
where Sr is the support function of the interval [r*,r*] defined by 

Sr{u) := sup uc, u G M. 

r*<c<r* 

Since ip is bounded, we can take expected values in (4.8) and divide by 6 to 
obtain 

1 f^^ 

^(r) dr 



E 



>0, 



<5, 

which, in the limit 6^0, implies that 

- gw{t, s, y) := sup{-a^'''''^w(i, s, y) : a G M and < s^c < T*} > 0, 

(4.12) 

where is given by (4.9). Combining (4.11) and (4.12), we obtain 

G(s, y, wt{t, s, y),Dw{t, s, y),D'^w{t, s, y)) 

:= mm{-gw{t, s,yy, s'^y - [s'^Ws - Sr {- Wy)]{t, s,y); 

- s^y+ [s^Ws + ST{wy)]{t,s,y)} > 0. 

With arguments similar to the ones used to show the subsolution property 
in [7], it can be proved that w is also a subsolution of the equation 

(4.13) G{s, y, wt{t, s, y),Dw{t, s, y),D^w{t, s, y)) = 0. 

We omit this proof because it has nothing to do with the small time behavior 
of stochastic integrals. 

4.3. DPE for the value function v. For the derivation of the DPE for 
V we have to restrict the control processes further by requiring that 7 is 
right-continuous and for all t € [0,T], there exists an e > such that almost 
surely, 

(4.14) r |7(u + i) -7(t)pdn = 0(ri+^) for ^ \ 0. 

JO 

Again, we proceed in three steps. 

Step 1: Dynamic programming. We assume that for each (t, s) G [0,T) x 
(0,00), there is an admissible control {y^v) = (y,a,7) such that 

^ls,x,yiT) >g{St,s{T)) where x = v{t,s). 

For a (t,r]-valued F^-stopping time r and 6 > 0, we set := r A (t + 5). 
As in Section 4.2, it can be shown that 

(4.15) v{t,s) + r Yr^,^y{r)dSt,s{r) > v{ts, StArs))- 



DOUBLE STOCHASTIC INTEGRALS 



21 



Step 2: Application of Ito^s lemma. Again, we assume that the value 
function v is smooth. Then, we can twice apply Ito's lemma in (4.15) to get 
for all S>0: 



(4.16) 
where 



Jt Jt L Jt 



u)du+ ip{u)dSt,.siu)} dSt,sir)>0 



c 

V'(r) 



■ Cv{r AT,St,sir At)), 
Vs{t,s) -y, 

■ Cvs{r A T, St,.sir A r)) - a{r), 
: Vss{r A r, St,sir A r)) - 7(r), 



and C is the Dynkin operator associated to the process S: 



Cv{t, s) := vt{t, s) + ^al,s'^Vss{t, s). 



If we set 

r := inf{r > t : | log St,s{r) — logs] > K}, 
for some constant K > 0, then the processes ^, (f) and ip are bounded. 

S'tep 3: Small time path behavior of double stochastic integrals. It follows 
from the boundedness of ^ that there exists a constant Ci > such that for 
ah 6>0, 



(4.17) 



^(r) dr 



<Ci6. 



From the boundedness of (f) and Proposition 3.9 it can be deduced that 

rrs rr 



(4.18) 



hm - 

<5\0 6 



t Jt 

■■ lim - 

s\o 5 



(t){u)dudSt,s{r] 

t+S cr 



4>(u) duSt^s{r)odW[r) 



0. 



Furthermore, since almost all paths of Si^s are Holder-continuous of order 
1/3, it follows from Corollary 3.7(a) that 



lim sup 



1 



(4.19) 



5\o h{b) 



■ lim sup ■ 



Ts rr 



1 



s\Q h{5) 
< oo. 



ij{u) dSt,s{u) dSt^s{r] 

t+5 rr 



i;{u)St,s{u)adW{u)St,s{r)cTdW{r) 
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It can be seen from (4.16) together with (4.17)-(4.19) that 



1 f^s 
'^^P /TTTY / CdSt,s{r)<0, 
vO \/n{d) Jt 



<5\0 \JKo) 

from which it can be derived by the Dambis-Dubins-Schwarz theorem and 
the law of the iterated logarithm for Brownian motion that C = 0- Therefore, 
(4.16), (4.17) and (4.18) imply that 

(4.20) limsup f ij(u) dSt,s{u) dSt,s{r) < 0. 

5\o Ko) Jt Jt 

Since ip is right-continuous, it follows from (4.20) and Corollary 3.7(b) that 
ip{t) < 0. Note that by the definition of tp and the gamma constraint (4.4), 

(4.21) T,<s\vss{t,s)-^P{t))<^*. 

By the boundedness and continuity of ^, we obtain from (4.16) and (4.18) 
that 

(4.22) ^(t)<lirninfi H f -i^{u)dSt,s{u)dSt,s{r). 

<5\0 Jt Jt 

Since v is smooth, the process fss(r, (S'j^cj(r)) is almost surely locally Holder- 
continuous of order 1/3. Hence, since 7 satisfies (4.14), the process ip sat- 
isfies (4.14) as well. Therefore, we can apply Corollary 3.8(a) to conclude 
that 

liminf-- / / -il'iu) dSt,s{u) dSt,s{r) 
<5\o 6 Jt Jt 

= liminf^ f -ij{u)Sts{u)adW{u)Sts{r)(TdW{r) 

<5\0 Jt Jt 



which together with (4.22) shows that 

1 
2 

that is, 

(4.23) - vt{t, s) - \a'^s^{vss{t, s) - i;{t)) > 0. 
Combined, (4.21) and (4.23) yield the following: 

F{vt{t,s),s'^Vss{t,s)) := sup F{vt{t, s) , s'^Vssit, s) + /3) >0, 

/3>0 

where 

F{p,A) ■.= mm{-p- ^a'^A;T* - A;A-T^}. 

In [2] it is proved under weaker assumptions and with more general control 
processes that the value function f is a viscosity solution of the equation 

(4.24) F{vt{t,s),s\ss{t,s)) = 0. 
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4.4. Discussion of the assumptions and related literature. Using approx- 
imation arguments, it can be shown that w is a viscosity solution of the 
DPE (4.13) without the assumption that it is always a minimum and smooth 
(see [7] for more details). Under additional continuity conditions on 7 it can 
also be shown that f is a viscosity supersolution of the DPE (4.24) without 
assuming that it is always a minimum and smooth. For instance, with the 
arguments of Section 5 of [2] it can be shown without assumptions on v that 
it is a viscosity supersolution of (4.24) if 7 is required to be of the form 

(4.25) -f{r) = z+ r -f^{u)du+ f\^{u)dW{u), re[t,T], 
Jt Jt 

for z G M and 7^,7^ progressively measurable processes, and suitable bound- 
edness conditions are satisfied. It is an open problem whether the supersolu- 
tion property of v can be shown without continuity assumptions on 7 such as 
(4.25) or (4.14). Another open problem is whether the value function v cor- 
responding to trading strategies of the form (4.3) with 7 of the form (4.25) 
is also a subsolution of (4.24). 

However, assume that g is continuous and let v^^{t,s) =E[g{St^s{T))] be 
the Black-Scholes price of g{St^s{T))- Then it follows from the comparison 
result, Proposition 3.9, in [2] that v > v^^ on [0,r) x (0, 00), and v > v^^ on 
[0,T) X (0,00) whenever the function g{s) + r*logs is not concave. On the 
other hand, without boundedness assumptions on the process a in (4.3), it 
follows from Theorem 4.4 in [1] that v < v^^ on [0,T) x (0, 00) irrespective 
of the form of g. 

To allow for a proof of a partial dynamic programming principle that is 
needed in the proof of the subsolution property of the value function, the 
control processes in [2] are also permitted to contain finitely many jumps. 
More precisely, the trading strategies in [2] are of the form 

y{r) = J2 y"l{T-„<r<r„+i} + / a{u)du+ / -f{u) dSt,s{u), 

(4.26) 

re[t,T], 

where i = tq < ri < • • • is an increasing sequence of [t, T] -valued F^-stopping 
times such that the random variable := inf{?i G N : r„ = T} is bounded, all 

are ^^(Tn)-measurable random variables and a, 7 are F^-progressively 
measurable processes satisfying certain boundedness and continuity condi- 
tions (see Section 2.2 in [2]). 

Denote by i;J"™p** the value function corresponding to this class of trading 
strategies. It is shown in [2] that v^^"^^^ is the unique viscosity solution 
of (4.24) in a certain class of functions. Again, for continuous g, it follows 
from the comparison result. Proposition 3.9 in [2], that tiJ"™?^ > on 
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[0,r) X (0,cx)), and ijJ^'^p" > v^^ on [0,T) x (0,oo) whenever g + r*log{s) is 
not concave. On the other hand, if the number of jumps in (4.26) is only 
required to be finite but not bounded, then it follows from Lemma A. 3 in [3] 
that uj""^P'^ < v^^ on [0, T) x (0, c5o) for all g. 
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